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Abstract 

The  L^  norm  has  been  widely  studied  as  a  criterion  for  curve 
fitting  problems.  This  paper  presents  an  algorithm  to  solve  discrete  approx¬ 
imation  problems  in  the  L^  norm.  The  algorithm  is  a  special-purpose  linear 
programming  dual  method  which  employs  a  reduced  basis  and  multiple  pivots. 
Results  of  the  computational  experience  with  a  computer  code  version  of  the 
algorithm  are  presented. 


R.  D.  Armstrong,  Associate  Professor 
University  of  Texas  at  Austin 
Austin,  Texas  78712 


M.  G.  Sklar,  Assistant  Professor 
St.  Edwards  University 
Austin,  Texas  78704 


1.  Introduction  and  Problem  Statement. 

The  Lg,  norm  problem,  also  called  minimax  and  the  Chebychev 
problem,  has  been  widely  studied  as  a  criterion  for  curve  fitting. 

m 

This  procedure  minimizes  the  maximum  residual,  and  is  particularly 
well  suited  to  problems  found  in  numerical  analysis  (Rabinowitz  (1968)), 
where  a  typical  application  arises  when  values  are  truncated  to  a  fixed 
number  of  decimal  places;  and  the  resulting  errors  due  to  round-off 
are  assumed  to  have  an  underlying  uniform  distribution.  Of  particular 
interest  in  numerical  analysis  is  the  error  between  the  approximation 
of  a  function  and  the  true  function.  It  is  desirable  to  place  a 
bound  on  the  error,  and  in  the  absence  of  a  priori  knowledge  of 
what  the  numbers  involved  will  be,  it  seems  reasonable  to  allow  for 
the  worst  case.  Then  the  goal  is  to  utilize  a  procedure,  for  approx¬ 
imating  the  function,  which  produces  the  minimum  maximum  error,  hence 
the  minimax  or  norm  method  (see  Ralston  (1965)). 

Although  other  procedures  are  more  popular  for  "statistical 
data  analysis,"  the  L  norm  may  be  useful  in  identifying  outliers 
(Sposito  (1976)).  Stiefel  (1959)  developed  a  method  called  the 
"exchange  method"  for  finding  norm  estimates,  and  he  later  (1960) 
established  the  equivalence  of  the  method  to  the  simplex  procedure. 
Harter  (1975)  and  Stiefel  (1964)  discuss  the  historical  development 
of  the  norm  estimation  procedure,  and  Appa  and  Smith  (1973)  iden¬ 
tify  a  number  of  important  properties. 

It  is  generally  accepted  that  some  form  of  linear  programming 
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algorithm  provides  the  most  efficient  way  to  determine  the  U  norm 
estimates.  The  purpose  of  this  paper  is  to.present  a  specialized 
dual  linear  programming  algorithm  for  obtaining  a  Chebychev 
approximation  to  an  overdetermined  system  of  linear  equations  for 
the  model  C  =  AT6  +  c.  The  algorithm  uses  a  reduced  basis,  multr- 
pie  pivots »  and  a  reduced  ratio  test. 


3 


1.1  Statement  of  the  problem 

The  general  norm  problem  may  be  characterized  in  the  follow¬ 
ing  way.  Let  (c^  ,  a^  ,  a-g  a-m),  i  =  1»  2,...,n  represent 
the  values  observed  during  n  repetitions  of  an  experiment,  where  c 
is  a  vector  of  observed  values  of  the  dependent  variable  and  the  a's 
are  the  observed  values  of  the  independent  variables  (the  predictor 
variables).  The  objective  is  to  determine  estimates 

for  the  parameters  8  =  (8-.,  B9,  ....  8  )  which  solve  the  problem: 

—  it  m 

(1)  Minimize  the  value  of 

X  =  maximum{|c.j  -  a^8^  -  ai2®2  ”  •••  “  aim®m^* 
i  =  1,2,... ,n 

It  is  a  well-known  result  that  (1)  may  be  expressed  in  a  linear  pro¬ 
gramming  formulation  (L.  P.)  as  follows: 

(2)  Minimize  X 

m 

subject  to  c-  -  X  <  Z  a^8.-  <  c.  +  X  ,  i  =  l,2,...,n 

I  J  * 

c  * 

where  the  optimal  estimates  of  8  will  minimize  the  maximum  deviation 

(M. 

In  matrix  notation,  the  constraints  of  (2)  are 

(3)  c  -  eX  <  AT8  <  c  +  eX  , 

where  e  is  a  vector  of  ones  and  AT  is  an  n  by  m  matrix. 

It  is  assumed  that  has  full  column  rank:  that  is, 

T 

rank  (A‘)  =  m.  Rank  deficiencies  can  easily  be  handled  within  the  . 
linear  programming  framework  (see,  for  instance,  Ben-Israel  and 
Charnes  (1968)),  and  will  not  be  reviewed  here.  Each  interval  con¬ 
straint  may  be  written  as  two  constraints  which,  when  combined 


with  the  objective  function,  results  in  the  following  problem. 

v4)  Minimize  X 

subject  to  +  ex  >  C 

ATB  -  ex  <  C  . 

The  linear  programming  dual  of  (4!  may  be  written  as 
(51  Maximize  C^r'  +  CT^" 

subject  to  A  +  A  =  9 

eTir'  -  eV  =  1 

it*  5^  0  ,  ir“  <  0  . 

Problem  (5l  may,  of  course,  be  solved  using  the  traditional 
simplex  method,  which  will  be  discussed  in  the  next  section.  This 
discussion  is  not  meant  to  be  a  complete  description  of  linear  prog¬ 
ramming,  but  rather  is  intended  to  establish  notation  and  terminology. 

A  short  summary  of  the  simplex  method  follows. 

Given  a  basic  feasible  solution,  corresponding  to  an  extreme 
point  of  the  solution  space,  a  nonbasic  variable  is  selected  to  enter 
the  basis.  (In  this  paper  the  usual  terminology  will  be  employed,  where 
a  variable  is  said  to  enter  (or  leave)  the  basis  when,  in  fact,  it  is 
the  vector  associated  with  the  variable  which  enters  (or  leaves)  the 
basis,  for  the  vector  space  R®*1.)  The  variable  selected  to  enter  the 
basis  is  a  variable  whose  corresponding  constraint  in  the  dual  of  the 
problem  being  discussed  violates  feasibility.  (In  the  example  of  this 
paper,  for  an  entering  variable  of  problem  (5),  the  corresponding 
constraint  of  problem  (4)  would  be  infeasible.)  The  variable  to  leave 
the  basis  is  selected  by  determining  the  minimum  of  a  set  of  ratios. 
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where  the  leaving  variable  is  the  first  variable  to  become  in¬ 
feasible  as  the  value  cf  the  entering  variable  changes. 

The  new  set  of  basic  variables  differs  by  one  from  the  pro¬ 
ceeding  set,  and  a  new  extreme  point  (ignoring  degeneracy)  in  the 
solution  space  is  represented  by  the  basis.  Since  a  finite  number 
of  extreme  points  exist  in  the  solution  space,  and  an  iteration  as 
described  above  moves  from  one  extreme  point  to  an  adjacent  (im¬ 
proving)  extreme  point,  the  algorithm  will  converge  to  an  optimal 
solution  in  a  finite  number  of  steps.  The  convergence  difficul¬ 
ties  that  arise  when  degeneracy  is  present  will  not  be  discussed 
in  this  paper.  The  reader  is  referred  to  Charnes  (1952)  for  a 
discussion  of  the  resolution  to  the  problem  of  degeneracy.  In 
the  next  section,  the  steps  of  the  general  algorithm  described 
here  will  be  discussed  further. 
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2.  General  Linear  Programming  Approach 

Prior  to  describing  the  general  L.  P.  approach  and  the 
specific  algorithm  presented  here,  a  msnber  of  terms  are  defined. 
(Note  that  the  omission  of  a  prime  or  double  prime  on  a  term  which 
usually  has  one  or  the  other  indicates  the  term  applies  to  both  the 
prime  and  the  double  prime  cases.) 

The  n  constraints  of  (2)  are  denoted  as  "variable 
interval"  (VI)  constraints.  This  terminology  arises 
from  the  fact  that  the  bounds  on  the  interval  may  be 
expanded  by  increasing  X. 

n  =  the  number  of  variable  interval  constraints  in  the 
primal  problem  (2); 

A. ^  =  the  m-dimensional  column  vector  for  the  j-th 
column  of  A,  where  A.^  is  the  same  for  both 

v 

and  irV  ; 

A 

Alj  =  the  (m+l)-dimensional  augmented  column  vector  for 
mi,  where  a  +1  is  appended  to  the  vector  A.j  ; 

A 

A'.^  =  the  augmented  vector  for  ttV ,  where  a  -1  is 

w  J 

appended  to  the  vector  A.  - . . 

J 
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k(1)  =  the  index  for  the  i-th  basic  variable,  i  =  1,2,..., 

•  ntf-1.  That  is,  if  either  ir'  or  it"  is  basic  at  the  i-th 

r  r 

position,  k(i)  =  r  ; 

F  =  the  (ith-1)  by  (m+1)  basis  for  the  dual  problem  (§)  ; 

b  =  the  original  right  hand- side  for  the  dual  problem  (5), 

l  =  (0,  0,...,0,1)T  ; 

b  =  the  (m+l)-dimensional  updated  right  hand  side  of 
(5),  b  =  F_1b  ; 

Cp  =  an  (ntf-1) -dimensional  vector  of  the  original  objec¬ 
tive  function  coefficients  for  the  basic  variables 
of  problem  (5)  ; 

=  the  original  objective  function  coefficient  in  the 
dual  problem  (5)  for  and  for  ir“ 

ci  =  the  reduced  cost  for  ir*  ; 

v  3 

c*!  =  the  reduced  cost  for  ir"  ; 

3  3 

A 

y'..  =  the  representation  of  A.*.  in  terms  of  the  basis  F» 

J  w 

so  that  y*.  -  =  F  a**  ; 

y".  .  =  the  representation  of  A“i  »  y*t.-  3  » 

NB'  =  { j lir*.  is  nonbasic}  ,  the  index  set  for  nonbasic 
3 

variables  of  the  type  ir’  ; 

NB"  =  {j  | -n!j  is  nonbasic} 

NB  =  NB'UNB" 

a  =  the  value  of  the  objective  function; 

S  =  the  parameters  to  estimate  in  the  primal  problem  (4). 


. ’*•*»  M«  btMM  . . . . 
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2.1  Steps  of  the  general  t.  P.  simplex  method. 

Given  a  basic  feasible  solution,  the  steps  of  the  general  L.  P. 
simplex  problem  may  be  stated  as  follows. 

Step  1.  Compute  the  reduced  costs  for  nonbasic  variables; 

jeNB’ 
jeNB" 

select  the  variable  to  enter  corresponding  to 


a.  cl  * 

J 

Cj  *  CFF 

,  for 

K  P'  - 

b*  c  •  ^ 
j 

T  -I  A 

Cj  *  CFF  A*j 

,  for  7t“ 

c. 


Step  5. 


d. 


max  {cl  ,  cj  >  0  ;  -cj  ,  c".  <  0} 
jeNB 

if  Fl  <_  0  and  Cj  0  for  all  j,  terminate  with  the 
optimal  solution; 


Step  2.  Compute  the  representation  for  Tt$,  the  entering  variable 

—  1 A 

a.  y*  3  F  A*  for  tt *  entering  the  basis  ; 

•  5  •  5  S 


F_1b 


b.  y"  3  F  A"  for  it"  entering  the  basis  ; 

•  5  •  5  S 

Step  3.  Compute  the  updated  right  hand  side 
a.  8 

Step  4.  Select  as  the  variable  to  leave  the  basis  that  variable 
corresponding  to  the  minimum  ratio 
a.  if  *  Ms  the  entering  variable. 


>  j  3  1,  2 . m+1 


If  it”  is  the  entering  variable. 


mm 


Ktl 


£l  <o 

y3s 


,  j  3  1,  2,  ....  nH-1 


c. 


if  the  minimum  occurs  for  j  =  r  ,  tv  .  leaves  the  basis 

k(r) 

Update  F"1  ,  CpF"1  ,  k(r),  NB*  and  NB'*.  Go  to  Step  1. 


ft 


% 

I 
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3.  Reduced  Basis  Structure 

This  section  discusses  how  the  full  tableau  data  may  be  repre¬ 
sented  with  a  reduced  basis.  The  traditional  approach  of  the  prior 
section  for  solving  the  L.  P.  problen  (51  may  be  altered  in  the  follow¬ 
ing  ways.  Instead  of  using  the  (m*-l)  by  (m*l)  matrix  F  to  solve  the 
system  of  equations,  an  m  by  m  basis  may  be  isolated  to  perform 
the  usual  simplex  steps.  The  primary  purpose  of  this  paper  is  to  show 
how  the  reduced  basis  may  be  efficiently  used  to  solve  (5). 

Throughout  the  paper,  a  distinction  will  be  made  between  two 
problem  structures:  the  full  structure  which  has  (ntf-l)  basic  variables, 
this  structure  corresponds  to  the  regular  simplex  tableau;  and  the  re¬ 
duced  structure  with  m  basic  variables,  which  are  the  first  m  of  the 
basic  variables  in  the  full  structure.  Consequently,  there  are  two 
representations  for  a  nonbasic  variable.  One  representation  is  in  tenas 
of  the  (nrt-1)  basic  variables  of  the  full  structure  and  the  other  is  in 
terms  of  the  m  basic  variables  of  the  reduced  structure. 

Several  advantages  become  evident  when  the  reduced  basis 
structure  is  used.  The  usual  simplex  steps  may  be  performed  in  terms 
of  the  reduced  basis,  and  a  reduced  rainimwn  ratio  procedure  is  pre¬ 
sented  which  provides  a  simpler-  ratio  formulation,  and  which  may  result 
in  fewer  ratios  computed  than  in  the  full  tableau.  Multiple  pivots  may 
be  performed,  where  a  multiple  pivot  allows  a  movement  to  an  adjacent 
extreme  point  without  updating  the  basis. 


3.1  Partitioning 


The  proposal  is  to  construct  a  reduced  basis  with  which  to  perform 
the  simplex  operations.  Since  the  basis,  F,  for  the  full  structure  (5) 
has  linearly  independent  columns,  it  may  be  partitioned  in  the  follow¬ 
ing  manner: 

B  =  the  m  by  m  basis  for  the  reduced  structure.  The  columns  of 
B  are  those  columns  of  A  corresponding  to  the  first  m  basic 
variables  of  the  full  structure; 

G  =  the  m- dimensional  column  vector  of  A  corresponding  to  the 
(mfi)-st  basic  variable  in  the  full  structure,  so  that 
G  =  A  ,  .  ... 

0  *  the  row  vector  for  the  (ntf-l)-st  row  of  F,  so  that 


1  if  it,'  ...  is  basic 
k(i) 

1  1-1  if  it"  .  is  basic 

k(i) 


for  1  <  i  <  m; 


f  = 


f 


the  (m+l)-st  element  of  the  column  A  associated 

•jcim+A) 

with  the  (m+l)-st  basic  variable  in  the  full  structure, 
so  that 

1  if  ir'  ...  is  basic 
k(m+l) 

~1  i f  tt"  is  oasic 
k(a+l) 


Note  that  appending  D..  to  B..  gives  A.k(i) »  i  =  l,2,...,m,  and 

A 

appending  f  to  G  gives  A  , 

.fc(m+U 


3.2  Updated  Right  Hand  Side 

The  right  hand  side  values  for  the  basic  variables  in  the  full 


structure  may  be  described  as  follows: 


■(5)- 


where 


b.j  =  the  value  ^orirk(ij»  *  =  1»2,...,(mfl)  , 

a. 

where  b  =  F  b. 

A 

To  facilitate  the  partitioning,  b  may  be  separated  as  b 

A  ^ 

F  is  the  first  m  entries  of  b  and  W  is  the  (m+l)-st  entry  of  b. 

a  T 

The  goal  is  to  write  b  3  (F  W)  in  terms  of  the  reduced  basis  B.  It 

1  /W  A 

has  been  previously  noted  that  F  b  =  b,  so  Fb  =  b  .  Then,  using 
the  partitioning  of  F  from  the  previous  section,  and  the  separation 
of  b  into  F  and  W  , 


(!  !)(!)■  (!) 


a  b  . 


Performing  the  multiplication, 

BF  +  GW  =  0 

OF  +  fW  *  1  . 

However,  G  =  A.k(m+1)  >  so  that 

B-1G  =  B~]A  *  a 

•k(m+l)  a  *k(m+l) 

where  a  is  defined  to  be  the  m-dimensional  representation  for 

tt  in  terms  of  the  reduced  basis  8.  For  rotational  conveni- 

k(m+l) 

ence,  let 


R  3  a 


k(m+l) 


To  continue, 

BF  3  GW  3  0  , 

A* 

F  3  B-1GW 
F  3  -RW. 


•k(m+l) 


.k(m+l) 


,W 


Also, 

Ob  +  fW  3  1  ->  D(-RW)  +  fW  =  1  W(f  -  DR)  =  1  . 

For  notational  convenience,  define 
sumr  =  (f  -  OR)  , 

so  W(f  -  DR)  3  1  ,  W(sumr)  3  1  , 
thus  W  3  1/sumr  . 

To  suiranarize,  the  right  hand  side  values  for  the  basic  variables, 

written  in  terms  of  the  reduced  basis  B,  are 

/b\  /-Rw\,  /-R/sumr \ 

\W/  \  W  /  \  1/sumr/  . 


3.3  Selection  of  the  Entering  Variable 

The  reduced  cost,  c^  or  c!|  ,  for  a  variable  may  be  described  as 
the  change  in  the  objective  function  value  per  unit  change  in  the  value 
of  the  entering  variable.  The  convergence  of  the  simplex  algorithm 
depends  only  on  selecting  a  variable  to  enter  the  basis  which  has  a 
positive  rate  of  change;  however,  the  implementation  used  here  selects 
as  the  entering  variable  that  variable  which  has  the  largest  rate  of 
change. 

The  reduced  costs  may  be  computed  by 

'j  ■  V  CFr’*'-J 

Cj  Lj  CFF  A‘j  * 
and  the  largest  rate  of  change  corresponds  to 

jeNB  j  cj  »  cj  0  1  cj  ’  cj  0  * 

The  optimality  conditions  are  c^  ±  0  and  c^  >_  0  ,  for  every  jeNB, 
in  which  case  the  algorithm  terminates  with  the  optimal  solution.  The 
optimality  conditions  for  this  dual  problem  (5)  are  related  to  the 
feasibility  conditions  for  the  primal  problem  (4)  ,  in  the  sense  that 
selecting  the  entering  variable  with  the  largest  rate  of  change  in 
X  is  tantamount  to  bringing  feasibility  to  the  primal  constraint  which 
is  most  infeasible  with  the  current  solution. 
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3.4  Representation  of  the  Entering  Variable 

Suppose  the  method  of  the  previous  section  has  selected  ir  as 

s 

the  entering  variable.  The  following  introduces  additional  notation. 

A 

a.s  =  the  m  elements  in  the  representation  for  irs,  which 

is  y>s,  in  terms  of  the  full  basis  F  ; 

V  =  the  (m+l)-st  element  in  the  representation  for  ir  in 

s 

terms  of  the  full  basis  F  ; 

s  =  a>s-=  the  m-dimensional  representation  for  ir  in  terms  of  the 

reduced  basis  B,  so  that  B~^A  =  a* 

•s  .s 

Since  the  augmented  column  vectors  for  ir'  and  ir"  ,  A'  and  A"  ,  differ 

s  s  *s  *s  * 

only  in  the  last  element,  which  is  defined  to  be  g  ,  then  either  y' 

•S 

or  y"$  (the  representations  in  terms  of  the  full  basis  F  for  ir*  and 
^s)  may  be  partitioned  as  (a>s  V)  ,  where  the  sign  of  g  determines 
which  of  A|s  or  A"$  is  being  represented. 

Then  using  the  partitioned  version  of  F,  and  separating  y 
into  (a  V)^  ,  we  have 


c  :>  t  v)  •(:■•) . 


so  that  the  element  g  may  be  defined  as 


1  i*  ir^  is  entering  the  basis 
-1  if  iTg  is  entering  the  basis 


Performing  the  multiplication, 

Ba  +  GV  =  A  . 

«s  .$ 

Da  +  fV  =  g  . 
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Solving  the  first  equation  for  a>$  , 
a  .  =  B-1(A  -  GV)  =>  B^A 

•J  » 

a  _  =  8-1A  „  -  B-1A  V 
•s  -S  •k(nrt'l) 

A  — 

a  _  =  a  »  a  V. 

•s  -s  k(n+l) 


B^GV 


Solving  the  second  of  the  equations, 

Da  e  +  fV  =  g 
D(S  -  RV)  +  fV  =  g 
DS  +  V(f  -  DR)  s  g  . 

Recalling  that  W  *  l/(f  -  DR)  a  1/surnr, 
then  DS  +  V/W  =  g 
V/W  =»  g  -  DS  . 

Define  sums  =  3  -  DS  , 
then  V/W  =  sums  , 

V  =  sums/sumr  . 

Therefore,  the  representation  for  it  in  terms  of  the  full  structure 
is  y  c  =  (a  c  V)  ,  which  has  now  been  written  in  terms  of  the  reduced 
basis,  so  that 


(«'s)  *  ( * : 


-  RV  \ 

sums/sumr  /  . 
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4.  Simplification  with  the  reduced  structure 

Solving  the  du  jroblem  (5)  using  the  reduced  basis  B  offers 
several  advantages,  wh.  i  will  be  discussed  in  this  section. 

The  original  primal  problem  (3)  had  n  interval 
constraints  which  were  separated  into  2n  constraints,  so  the  dual 
problem  (5)  has  2n  structural  variables.  However,  there  are  n  pairs 
of  variables,  n!  and  ir"  ,  for  which  the  A.  -  vector  is  identical,  and 

A  A 

the  augmented  vectors  of  A.  .  ,  Al  -  andA'J  .  ,  differ  only  in  the  entry 

J  J  J 

in  the  (m+l)-st  (last)  element.  To  exploit  this  pairing,  the  algorithm 
computes  reduced  costs  for  n-(m+l)  rather  than  for  2n-(nH-l)  nonbasic 
variables.  For  any  pair  and  ir^'  the  reduced  costs 
differ  by  2X  ,  since  A'.  -  and  A",  differ  only  in  the  sign  of  the  "1" 

o  J 

in  the  last  entry. 

Additionally,  selection  of  the  variable  to  leave  the  basis  may 
be  simplified  using  the  reduced  structure.  The  minimum  of  ratios  of 
the  form  R^/S.  will  designate  the  leaving  variable,  and  some  of  the 
ratios  may  be  ignored,  since  it  may  be  anticipated  they  will  not  be 
the  minimum. 

Also,  a  multiple  pivot  may  be  performed,  which  includes  a 
"pivot"  where  the  basis  is  not  changed  in  the  reduced  structure 
(aHhough  in  the  full  structure  a  basis  change  would  occur).  This 
exchange  of  variables  does  not  affect  the  basis  and  therefore  re¬ 
sults  in  a  savings  in  computation. 
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The  reduced  structure  has  m  basic  variables  but  the  (m+l)-st 
basic  variable  in  the  full  structure,  it..  , , , ,  will  be  treated  as  a 
pseudo-basic  variable  in  the  reduced  structure.  For  convenience,  the 
variable  will  be  denoted  by  tt.  ,  ..  in  the  reduced  structure  just  as 
it  is  in  the  full  structure.  This  variable  will  play  a  role  in  the 
reduced  structure  as  though  it  were  basic,  in  the  sense  that  a  variable, 
tts,  entering  the  basis  in  the  reduced  structure  will  replace  a  current 
basic  variable  if  possible,  and  otherwise  will  replace  ir,  ,  ...  If 

K  1X0x1} 

\(m+D  ^g*  n0  basis  change  occurs  in  the  reduced 

structure,  although  in  the  full  structure  an  explicit  basis  change 
would  occur.  Treating  the  variable  irk(m+1)  as  a  pseudo-basic 
variable  in  this  fashion  enables  the  same  extreme  point  path  to  be 
followed  in  the  reduced  structure  as  is  followed  in  the  full  structure. 


4.1  Computing  the  Reduced  Costs 

Using  the  reduced  structure  may  result  in  some  simplification 
when  determining  the  reduced  costs  of  the  dual  problem  (5).  To  see  this, 
we  consider  the  primal  problem  (41.  In  essence,  the  procedure  will  be 
to  compare  the  i-th  residual  from  the  fitted  plane  (for  the  current 
values  of  B)  to  the  current  value  of  X.  This  is  analagous  to  computing, 
in  the  primal  problem  (41,  the  amount  of  infeasibility  of  a  particular 
constraint. 

To  aid  in  the  discussion  of  the  computation  of  the  reduced 
costs,  the  following  terms  are  defined. 

c .  is  the  reduced  cost  for  the  j-th  nonbasic  variable, 

J 

which  may  correspond  to  either  tt^  or  , 
depending  on  the  sign  of  the  residual; 

~T 

hj  =  Cj  -  B  A.j,  so  that  hj  is  the  j-th 

A  A  A 

residual  from  the  fitted  line  aB  =  (a^  +  a^2  +  ... 


then, 

a-  =  lcj  “  STA.j|-X  , 

Cj  =  |  ^  I-X  . 

If  h.  >  0  ,  c -  is  the  reduced  cost  for  it!  ; 

J  J  3 

If  hj  <  0  ,-Fj  is  the  reduced  cost  for  ir^  ; 

suppose  hj  >  0,  so  only  ^  will  be  a  candidate.  This 


1. 
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means  that  the  point  (a 

on  the  fitted  plane  (which  will  be  called  the  fit)  is 

below  the  observed  point  (Cj,ajj,a2j,...,amj).  If 

hj  -  X  >  0,  then  the  fit  is  below  the  bound  Cj  -  X; 

thus,  the  primal  constraint  c.  -  X  <  A  S  is  infeasible, 

J 

and  Hi  is  the  dual  variable  associated  with  this 
constraint.  If  h.  -  X  <0,  the  fit  is  within  the 

J 

interval  bounds  and  the  constraint  is  feasible. 

2.  For  the  case  where  h.  =  c^  -  8TA.-  <0,  similar 

J  J  J 

reasoning  suggests  that  c.-  is  the  reduced  cost  for  ir|!, 

J  3 

and  the  reduced  cost  for  may  be  ignored,  as  its 
associated  constraint  in  (2)  must  be  satisfied. 


Then,  the  variable  selected  to  enter  the  basis  is  the  variable  corres¬ 
ponding  to 

max  (Cj )  ,  for  cj  >  0, 
jeNB'nNB" 

and  terminate  with  the  optimal  solution  if  no  maximum  exists. 

(Ir.  relating  the  reduced  costs  described  above  to  those  encountered  in 

the  full  tableau,  the  sign  of  F-,  when  c.  refers  to  it"  ,  will  be  nega- 

J  J  3 

tive  in  the  tableau  but  positive  in  this  algorithm.) 

Note  that  when  it  is  basic  (either  ir'  or  tt"),  the  reduced 
p  p  p 

cost  for  its  nonbasic  complement  it  (either  tt"  or  ir’)  is  not  considered. 

p  p  p 
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This  will  be  discussed  in  detail  in  the  multiple  pivot  section,  where 
the  procedure  is  given  which  determines  when  the  complement  of  a  basic 
variable  should  be  considered  a  candidate  to  enter  the  basis. 


K 


22 


4.2  Ratios  Using  the  Reduced  Basis 

In  this  section  it  will  be  shown  that  utilizing  the  reduced 
basis  may  result  in  the  computation  of  fewer  ratios,  and  that  the  ratio 
test  procedure  of  the  reduced  structure  (computing  ratios  of  the  form 
R./S^)  is  equivalent  to  the  procedure  of  the  full  structure,  in  the 
sense  that  both  procedures  select  the  same  variable  to  leave  the  basis. 

Prior  to  the  discussion  of  the  ratios,  it  may  be  helpful  to 
summarize  some  of  the  previous  results.  The  following  is  a  partial 
tableau  for  the  full  structure,  where  the  entries  are  written  in  terms 
of  the  reduced  basis. 


Basis 

TT 

3 

RHS 

Ratios 

X 

\(D 

s 

sr¥ 

X 

-Rj/sumr 

(-R-j/sumri/tS^-R^  (sums/sumr)) 

\(2) 

• 

• 

W 

• 

• 

-Rg/sumr 

• 

• 

(-Rg/sumrJ/tSg-Rgtsums/sumr) ) 

• 

• 

• 

\(a) 

• 

vv 

• 

-R^/sumr 

• 

(-Rysumr)/(Sm-Rjsums/sumr) ) 

sums 
v  sumr 

1/sumr 

1/sums 

sums  f  0 

The  i-th  ratio  in  the  reduced  structure  is  of  the  form  R./$^  , 
and  if  Rt/S^  is  the  minimum  ratio  in  the  reduced  structure,  then  the 
corresponding  variable,  ir^  ,  is  selected  to  leave  the  basis. 

Two  variables,  ik  and  rr  ,  will  be  said  to  be  the  same  type  of 
variable  if  both  are  restricted  to  be  >.  0  (that  is,  irt  and  ttI )  or  if 
both  are  restricted  to  be  £  0  (such  as  tt“  or  ir").  The  following  function 
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is  defined  to  determine  the  sign  of  a  auantity  £: 

(1  if  S  >  0 
sign  (0  =  { 

(-1  if  £  <  0 

The  above  sign  function  will  be  used  to  determine  which  of 
the  ratios,  R^/S^  ,  should  be  candidates  and  which  may  be  ignored. 
(For  convenience,  the  following  two  statements  will  be  considered 
equivalent: 

(1)  a  ratio  will  be  considered  a  candidate...;  and 

(2)  the  variable  associated  with  a  ratio  will  be  considered 
a  candidate...). 

Recall  the  scalar  f  is  the  (m+l)-st  element  in  the  vector 

A 

A.k(nH-l)  >  and  f  is  either  +1  (for  or  -1  (for 

Recall  also  that  g  is  the  (nH-i)-st  element  in  the  vector 

A 

A  ,  and  g  is  either  +1  (for  it'  )  or  -1  (for  tt”  )  . 

*<>  »s  »s 

Then,  the  l-th  ratio  in  the  reduced  problem,  Rj/S^  ,  will  be  con¬ 
sidered  a  candidate  when 

fg  =  -sign(Ri)  *  sign(Si)  ,  Si  f  0  . 

If  this  condition  fails,  the  associated  ratio  need  not  be  consid¬ 
ered  (nor  computed),  since  the  ratio  will  not  be  the  minimum.  In 
the  computer  code,  an  equivalent  condition  must  be  satisfied  for 
a  ratio  to  be  considered  a  candidate: 

D^g  =  sign  (Si)  . 
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For  convenience  in  isolating  terms,  the  ratio 
(-R^/sumrJ/lS^-R^sums/sumr) 
will  be  written  as 

l/((-S^/R^{sumr  +  sums)),  R^  f  0  , 

When  R^  s0,  the  results  which  follow  concerning  the  relationship 
between  the  reduced  and  full  ratios  follow  in  a  trivial  manner. 

To  show  that  the  reduced  ratio  test  is  equivalent  to  the 
regular  ratio  test  in  the  full  structure,  four  lemmas  will  be 
presented.  For  each  lemma,  only  che  case  where  is  in  the 

basis  and  ir"  is  the  entering  variable  will  be  considered.  The 
other  three  cases  follow  similar  logic.  Since  ^(ra+1)  is  basic, 
and  variables  of  the  type  tt*  are  restricted  to  be  nonnegative, 
then  sumr  >  0  ,  because  =  1/sumr  >0.  Since  ir^  is  the 

entering  variable,  only  variables  associated  with  negative  ratios 
will  be  candidates  to  leave  the  basis.  Further,  because 
and  Hg  are  different  types,  the  i-th  ratio  in  the  reduced  struc¬ 
ture  will  be  a  candidate  only  when  the  signs  of  R^  and  S^  are  the 
same. 

Lemma  1 


If  the  i-th  ratio  in  the  reduced  structure  is  a  candidate, 
and  the  corresponding  i-th  ratio  in  the  full  structure  is  a  candi¬ 
date,  then  the  (ntf-l)-st  ratio  is  not  the  minimum  ratio  for  the  full 
structure. 

Proof 

If  the  (m+l)-st  ratio  in  the  full  structure  is  not  a  candidate 


the  lemma  is  satisfied.  If  the  {m+l)-st  ratio  is  a  candidate,  sums  is 
negative,  since  the  (m+l)-st  ratio  is  1/sums,  and  only  negative  ratios 
may  be  considered.  If  the  i-th  ratio  in  the  reduced  structure  is  a 


candidate,  the  signs  of  and  S.  are  the  same.  Then  the  corresponding 
i-th  ratio  of  the  full  structure  is  related  to  the  (m+l)-st  ratio  of 
the  full  structure  by 


1 

< 

1 

(-S1-/R.j)sumr  +  sums 

sums 

since  both  terms  in  the  denominator  of  the  i-th  ratio  are  negative. 

This  result  establishes  lemma  1. 

Lemma  2 

If  the  i-th  ratio  in  the  reduced  structure,  R1-/Si  ,  is  not  a 
candidate,  but  the  corresponding  i-th  ratio  in  the  full  structure  is  a 
candidate,  then  the  i-th  ratio  in  the  full  structure  is  not  the  minimum 
ratio  in  the  full  structure. 

Proof 

Since  the  i-th  reduced  ratio  is  not  a  candidate,  the  signs  of 
R.j  and  are  different,  which  means  the  first  term  in  the  denominator 
of 

1  _ 

(-Sj/R^sumr  +  sums 

is  positive,  and  this  requires  sums  to  be  negative  for  the  i-th  full 
ratio  to  be  a  candidate.  Because  sums  is  negative,  the  (m+l)-st  full 
ratio  is  a  candidate,  so  that  the  i-th  and  (m+1 )-st  ratios  in  the  full 
problem  are  related  by 
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Lemma  3 

If  the  i-th  ratio  in  the  reduced  structure  is  a  candidate  but 
the  i-th  ratio  in  the  full  structure  is  not,  then  the  i-th  ratio  in  the 
reduced  structure  is  not  the  minimum  of  the  reduced  ratios. 

Proof 

If  the  i-th  reduced  ratio  is  a  candidate,  the  signs  of  and 
are  the  same  and  S./  0,  For  the  i-th  ratio  in  the  full  structure  to  not 
be  a  candidate,  the  ratio  must  be  positive,  so  that 

(-S./R.Jsumr  +  sums  >  0  *  Ri  *  0 

The  first  term  in  the  denominator  is  negative,  which  requires  that 
sums  >  0  ,  so  that 

(S^/R^Jsumr  <  sums,  and 

•  i 

(Ri/Si)  >  (sumr/sums). 

Since  the  i-th  reduced  ratio  is  a  candidate,  and  the  i-th  full  ratio 
is  not,  the  (m+l)-st  ratio,  1/sums  ,  cannot  be  a  candidate  because 
only  negative  ratios  may  be  eligible,  and  sums  is  required  to  be 
positive  to  insure  the  i-th  full  ratio  is  not  a  candidate.  Therefore, 
since  the  i-th  and  (m+1 )-st  ratios  are  not  candidates  in  the  full 
structure,  some  other,  ratio  in  the  full  structure,  call  it  the  j-th 
ratio,  must  be  a  candidate.  Then 

(-S./R*)sumr  +  sums  <  ^  0  ’ 

J  J 

Since  sums  >0,  the  first  term  in  the  denominator  must  be  negative, 
which  requires  that  Rj  and  Sj  have  the  same  signs,  which  means  the  j-th 
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reduced  ratio  is  a  candidate.  Because  the  j-th  full  ratio  must  be 
negative  (for  it  to  be  a  candidate), 

|(-S./R.)sumr|  >  sums  , 

J  J 

($./R.)sumr  >  sums  , 

J  J 

(R./S.)  <  (sums/sumr)  ,  R.  ,  S.  ,  sumr  t  0  . 

J  J  J  J 

Thus  the  relationship  between  the  i-th  and  j-th  ratios  of  the  full 
structure  is 

(R./S.)  <  (sums/sumr)  <  (R./S.) 

J  J  *  • 

and  this  result  proves  the  lemma. 

Lemma  4 

Suppose  the  i-th  and  j-th  ratios  in  the  reduced  structure  are 
candidates,  and  the  corresponding  i-th  and  j-th  ratios  in  the  full 
structure  are  candidates.  If  the  absolute  value  of  the  i-th  reduced 
ratio  is  smaller  than  the  absolute  value  of  the  j-th  reduced  ratio, 
then  the  same  relation  holds  in  the  full  structure. 

Proof 

Let  IR./SJ  <  |R.;/S.j  ,  which  means  for  the  case  being  con- 

•  ■  J  J 

sidered  that  R./S.  <  R./S.,  since  the  ratios  are  positive.  For  the 

*  *  \»  J 

full  structure,  the  corresponding  i-th  and  j-th  ratios  are 


1 

1  and  J  1 

(-S_./R..)sumr  +  sums 

1  j(-S  ./RJsumr  +  sums 

0  J 

Sumr  is  positive  since  ir'  ,,  =  1/sumr  is  basic.  Since  both  the  i-th 

k(rrtf\L; 

and  j-th  reduced  ratios  are  candidates,  the  first  term  in  the  denomin¬ 
ator  of  both  full  ratios  is  negative  (the  signs  of  R^  and  S.  are  the 
same).  Both  full  ratios  are  negative,  since  both  are  candidates,  and 
it  is  which  is  entering  the  basis.  Therefore,  for  each  full  ratio. 
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either  sums  is  negative,  or  sums  is  positive,  but  less  than  the  abso¬ 
lute  value  of  the  first  term  in  the  denominator.  In  either  case,  sums 
may  be  ignored. 

Since  R -/S .  <  R ./S .  ,  then  S./R.  >  S./R.  ,  so  that 

•  *  J  J  J  w 

|  (-S../R.)sumr|  >  |  (-S^/R^. )sumr|  , 

which  means  that 

1  ,  1  , 

| (-S^/R^)sumr|  I (“Sj/Rj)sumr| 

and  therefore  the  i-th  and  j-th  full  ratios  are  related  by 


1 

1 

(-S./R^sumr  +  sums 

< 

(-S./RJsumr  +  sums 

J  J 

which  proves  the  lemma. 

Theorem 

The  ratio  test  procedure  described  for  the  reduced  structure 
is  equivalent  to  the  ratio  test  procedure  for  the  full  structure,  in 
the  sense  that  both  procedures  will  select  the  same  variable  to  leave 
the  basis. 

Proof. 

It  follows  from  lemmas  1  and  3  that  the  .(m+l)-st  ratio  of  the 
full  structure  will  be  the  minimum  ratio  when  none  of  the  reduced 
ratios  are  candidates.  Otherwise,  from  lemmas  2  and  3  it  can  be 
ascertained  that  only  ratios  which  are  candidates  in  both  the  reduced 
and  full  structures  will  provide  the  minimums  for  the  respective 
structures.  Furthermore,  lemma  4  guarantees  that  these  minimums  will 
occur  at  the  same  position  in  the  reduced  and  full  structures. 
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4.3  Multiple  pivots 

The  general  idea  of  a  multiple  pivot  is  that  when  a  variable, 
say  enters  the  basis  in  place  of  a  current  basic  variable,  say  ir  , 

s  p 

the  increase  in  the  objective  function  value,  X,  may  be  sufficient  to 

cause  the  complement  of  ir  (call  it  it  )  to  become  eligible  to  enter 

P  P 

the  basis.  The  word  complement  will  be  used  in  the  sense  that  the 
complement  of  V  is  ir^J  and  vice  versa.  (When  it  becomes  a  candidate 
in  this  dual  problem,  this  means  the  corresponding  constraint  in  the 
primal  problem  (2),  which  was  binding  at  one  bound  becomes  infeasible 

/V 

at  the  opposite  bound.)  Since,  for  this  case,  irp  would  become  a  can¬ 
didate  to  enter  at  the  next  iteration  if  tts  enters  now,  the  algorithm 
brings  T?p  into  the  basis  immediately  in  place  of  irp  ,  and  tts  is  still 
a  candidate  to  enter  in  place  of  some  other  basic  variable.  This 
results  in  a  computational  saving,  since  the  represent  '■.ions  of  irp 

/v 

and  it  are  identical  in  terms  of  the  reduced  basis  B,  thus  no  basis 
p 

change  occurs  for  the  reduced  structure. 

For  this  discussion,  it  is  assumed  that  ir  has  been  selected 

s 

to  enter  the  basis  in  place  of  irp  (where  irg  may  be  iTg  or  iTg,  and 
similarly  for  ir  ),  and  that  ir  =  ir  ,  1  <_  t  <_m  ,  the  t-th  basic 
variable.  The  representation  for  irp  in  the  full  structure  is  a  unit 
vector,  but  the  representation  for  its  complement,  ir  ,  may  be  obtain¬ 
ed  in  a  manner  similar  to  that  used  to  find  the  representation  for 
ir  ,  so  the  discussion  is  abbreviated. 

“  C  “)(*>)  •(*.’) 
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The  results  of  the  multiplication  and  solving  for  a.p  and  L  are 
a.p  =  (P  -  RL)  , 

L  =  sump/sumr  , 
sump  =  £  -  OP  • 

P  *  a.p  ,  the  representation  for  rt  (and  rrp)  in  terms  of 

the  reduced  basis  B  , 

!1  if  tt  is  it* 

.p  p 
-1  if  ir  is  it" 

P  P 

Then,  a  partial  tableau  for  the  full  problem,  written  In  terms  of  the 


reduced  basis 

B,  is  shown  below. 

Basic 

A 

TT 

IT 

-E. 

ir 

3 

RHS 

X 

Fp  -  2X 

0 

s 

X 

fk(l) 

P1  -  "l1- 

0 

S,  -  R,V 

-R^/sumr 

• 

0 

• 

• 

• 

• 

« 

* 

• 

• 

0 

• 

• 

• 

* 

IT,  .  .  =  TT 
Ic(t)  P 

pt  -  RtL 

1 

St  *  RtV 

-Rt/sumr 

• 

9 

• 

• 

9 

• 

• 

* 

• 

• 

♦ 

\(m) 

Pm  -  RL 
m  m 

0 

W 

-Rm/sumr 

\(m+l) 

.  _  sump 
sumr 

0 

V  „  sums, 
sumr 

1/sumr 

(Note  that 

a  0  ,  i  f  t  , 

and  Pt  3  1 

,  since  A 

.k(t)  ,s  the 

column  of  B  and  P  =  B^A  ,  .  . 

•k(t) 

Since  7rshas  been  selected  to  enter  the  basis  in  place  of 

A 

it  ,  the  change  in  X,  6,  which  will  result  when  v  enters  the  basis  is 

F  39 
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3  =  |r^/(-Rt/sumr)/(St  -  RfcV) | 


6  =  |c$/sums|  . 

This  movement  in  X  ,6  ,  may  be  sufficient  to  cause  tt  to  become  a 

p 

candidate  to  enter  the  basis.  The  minimum  change  in  x  ,5*  ,  which 

will  enable  tt  to  become  a  candidate  may  be  shown  to  be 
p 

6*  =  2X  ((-Rt/sumr)/(Pt-RtL))  , 

which,  with  a  few  sign  changes  and  substitutions,  may  be  rewritten 


5*  =  -2xRt/(2Rt  +  £sumr)  . 


Therefore, 


a.  if  6  <  6*  ,  this  implies  that  when  tt  enters  the  basis, 

S 

/v 

the  change  in  X  is  not  sufficient  to  cause  ir  to  become 

p 

a  candidate  to  enter  the  basis.  Thus,  it  replaces  it  in 

s  p 

the  basis  and  the  usual  update  operations  take  place. 

b.  if  6*  <  6  ,  this  implies  that  if  tt  enters  the  basis  in 

s 

place  of  it  ,  the  change  in  x  would  be  sufficient  to 
p 

cause  tt  to  become  a  candidate  to  enter  the  basis  at  the 
p 

next  iteration.  Therefore,  it  enters  immediately  in 

P 

place  of  tt  and  tt  is  still  a  candidate  to  replace  some 
p  s 

other  variable. 


This  multiple  pivot  strategy  will  not  be  employed  when  the 
leaving  variable  is  »  since  if  t.he  complement  of  is 

brought  into  the  basis,  the  algorithm  finds  the  nonbasic  variable 
corresponding  to  the  next  minimum  ratio,  and  tts  then  replaces  this 
next  variable,  and  the  basis  is  updated.  Howe'  the  work 
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4 


associated  with  finding  the  next  smallest  ratio  and  then  per¬ 
forming  a  pivot  is  more  than  for  the  case  where  the  complement  of 
uk (ia*-i)  ^oes  n0^  en^er  tbe  basis,  and  a  multiple  pivot  is  not  per¬ 
formed. 

The  multiple  pivot  strategy  may  save  considerable  compu¬ 
tation.  As  evidenced  by  the  results  of  the  computational  exper¬ 
ience,  the  occasions  for  multiple  pivots  occur  between  17%  and  42% 
of  the  time,  depending  on  the  problem  size. 
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4.4  Steps  for  the  Reduced  Structure 

In  this  section,  the  steps  of  the  algorithm  discussed  in 
prior  sections  are  summarized.  Initially  assume  that  a  basic 
feasible  solution  is  at  hand. 

a.  the  parameters  to  estimate  in  the  primal  problem  (4) 

are  the  B's,  which  are  initially  computed  by  &  "  CgB”'*  . 

b.  the  value  of  the  objective  function,  X  ,  may  be  initially 
computed  by 

X  *  |cs/sums|  . 

The  initial  situation  is  that  a  reduced  basis  for  (5), 

consisting  of  m  variables  is  obtained.  The  full  structure 

has  m+1  basic  variables  and  the  (m+l)-st  variable, 

it  ,  ,  is  a  slack  variable.  Recall  that  the  variable 

k (m+1) 

ir,  .  is  to  be  treated  as  a  pseudo-basic  variable  in 
k(ra+l) 

the  reduced  structure,  and  at  this  juncture,  the  variable 
to  be  called  it,  ,  „  in  the  reduced  structure  has  not 

k(nrt-l) 

been  selected.  On  the  basis  of  reduced  costs,  suppose 

ir  is  determined  to  be  eligible  to  enter  the  basis, 
s 

Instead  of  replacing  a  current  basic  variable  in  the 
reduced  structure,  tt  will  become  the  variable  called 

S 

it,  ,  ,,  ,  and  X  must  be  adjusted  to  make  this  variable 
k(m+i) 

"basic."  In  the  full  structure,  however,  the  entering 
variable  irs  does  replace  the  basic  slack  (artificial) 
variable  in  the  (m+l)-st  position.  Since  initially  the 
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first  m  basic  variables  in  the  full  structure  equal  zero 

<a"‘>  Wd  equals  ona)- either  Kia  or  ”utr 
1  £  t  <_  m  ,  may  be  selected  to  be  basic.  By  proper 

choice  of  tt'  t  or  ir"  .  as  basic  variables,  the  ratio 
k(t)  k(t) 

for  the  slack  variable  may  be  forced  to  be  minimum,  so 

that  the  entering  it  will  replace  the  slack  tt,  ,  as 
’  s  k(ra+l) 

desired.  After  the  slack  variable  leaves  the  basis, 
the  iterative  process  begins. 

Step  1.  Compute  the  reduced  costs 

a.  Cj  -  |Cj  -  B  A.j|-X  = 

1.  if  h  -  >  0  ,  c.  is  the  reduced  cost  for  tt; 

J  J  3 

2.  if  n-  <  0  ,  -c”-  is  the  reduced  cost  for  tt'.'  , 

v  J  ] 

b.  determine 

max  {c.}  for  c^  >  0 
jeNB'ONB" 

and  let  the  variable  associated  with  this  stipulation 
be  TTg  ,  the  variable  to  enter  the  basis.  If  Cj  <  0  , 
for  all  j,  terminate  with  the  optimal  solution. 


Step  2.  Compute  the  reduced  ratios  to  determine  the  leaving  variable. 
Compute: 

min  {R./S^}  ,  i  =  l,2,...,m  , 

and  consider  R^/St  a  candidate  if  fg  =  -sign(Rt)  *  sign  (S^.) 
and  Sj.  f  0. 

There  are  two  cases  which  may  occur: 

a.  if  the  minimum  ratio  is  R^/S.  ,  ir  leaves  the  reduced 

•  «.  t  Jc(t) 

basis,  1  <  t<  m  ; 

b.  if  none  of  the  ratios  is  a  candidate,  the  entering 

variable  replaces  the  pseudo-basic  variable  tt.,  , 
and  no  basis  change  occurs.  In  the  full  structure,  of 
course,  an  explicit  basis  change  occurs  as  tts  replaces 
the  basic  variable  it,  ,  . 

k(nrt-l) 

Step  3.  Update  the  value  of  X  . 

Let  X  be  the  current  value  of  X  and  u  has  been  selected  as 


the  entering  variable.  There  are  three  cases  to  consider. 

a.  If  the  variable  leaving  the  basis  (of  either  the  reduced 
or  full  structure)  is  ir  »  1  £  t  <_m  ,  then 

Jv  v  W 

X  X  +  |  cs(-R^)/(S^.sianr  -  Rtsums)| 

b.  If  the  variable  being  replaced  is  x  , 

iC  (ffifl) 

X  «-  X  +  |  c^/suras)  . 

c.  For  the  case  where  a  multiple  pivot  occurs,  the  process 
for  updating  X  is  more  complicated.  Suppose  the  com¬ 
plement  of  a  current  basic  variable  enters  the  basis, 

a 

say  it  replaces  ir  (which  in  the  full  structure  would  be 

tr  p 


described  by  k(t)  =  p,  1  <  t  <  m. 

1.  When  the  exchange  occurs  (irp  replacing  itp),  X  is 
updated  by  computing 

X  X  -  2ARt/(2Rt  +  £sumr) , 

and  cs  is  updated  by 

cs^cs  -  6* | sums  -  (S./Rt)sumr|. 

2.  After  this  exchange  and  updating,  the  iteration  is 

still  not  complete  since  the  variable  tt  ,  which  was 

to  have  replaced  ,  must  now  enter  the  basis  in 

place  of  some  other  basic  variable.  To  effect  this, 

the  next  smallest  ratio  is  determined  (tt  had  the 

p 

minimum  ratio  previously),  and  the  variable  associat 
ed  with  this  next  smallest  ratio  is  replaced  by  irg  . 
Then  X  is  further  updated  to  reflect  this  change. 
There  are  three  cases  to  consider. 

a)  If  if  »  1  <  t  <  ra  ,  is  replaced  by  ir  , 

K  \w  "  "  S 

X  ♦X+  |c$(-Rt)/(Stsumr  -  Rtsums)|  ; 

b)  If  it  replaces  the  pseudo-basic  variable  ir. ,  ,, 
in  the  reduced  structure  (and  in  the  full 
structure  it  replaces  the  basic  variable  ir.  . 

S  it 

in  an  explicit  basis  change),  then 
X  «-  X  +  Jc-  /suosj  ; 


c)  If  a  multiple  pivot  occurs  here  {within  a 

multiple  pivot),  the  process  as  described  above 
repeats . 

Step  3.  Update  the  values  of  B  ,  by  computing 
8  =  (C 1  +  A)B_1  . 


Go  to  Step  1 
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5.0  Computational  Results 

The  special-purpose  algorithm  for  obtaining  norm 
estimates  of  the  parameters  for  the  model  C  =  ATf>  +  e  is  compared 
to  the  published  algorithm  of  Barrodale  and  Phillips  (1975). 

Our  algorithm  has  been  coded  in  FORTRAN  as  a  callable  subroutine, 
which  requires  an  n-dimensional  array  and  an  n  by  m  matrix  for 
the  input  data,  an  m  by  in  matrix  for  the  LU  decomposition,  and 
six  m-dimensional  arrays. 

An  LU  decomposition  procedure  is  used  to  solve  the 
system  of  equations,  and  since  much  of  the  original  data  are 
preserved,  the  incidence  of  round-off  error  is  diminished. 

All  runs  were  performed  on  a  CDC  6600  with  a  sixty  bit  word, 
the  tolerance  value  for  zero  was  set  at  l.E-8,  and  the  runs 
were  made  within  a  few  minutes  of  each  other,  so  the  machine 
load  was  approximately  the  same.  The  reported  times  were  from 
using  the  MNF  compiler,  although  the  algorithms  were  tested 
using  the  FTN  and  RUN  compilers  as  well.  The  IMSL  Library  was 
utilized  to  generate  an  array  (n-dimensional)  for  the  dependent 
variable  C,  and  an  m  by  n  matrix  A,  containing  data  which  were 
randomly  drawn  from  a  uniform  distribution.  For  each  problem 
size  (each  combination  of  m  and  n),  the  reported  time  is  an 
average  of  5  problems.  The  results  are  summarized  in  table  1. 
Our  code  is  denoted  AS  and  the  Barrodale  and  Phillips  code  is 
denoted  BP. 


TABLE  1:  A  summary  of  computational  testing  comparing  the 
special-purpose  dual  method  algorithm  (AS)  and  the  Barrodale  and 
Phillips  algorithm  (BP)  is  given.  Five  problems  were  solved  at 
each  level  and  the  reported  times  are  the  means  of  the  results 
in  milliseconds,  using  a  CDC  6600.  The  average  number  of 
iterations  is  also  reported. 


Average 


Problem 

Execution  Time 

Number  of 

Size 

(milliseconds) 

Ratio 

Iterations 

m  n 

AS 

BP 

BP/AS 

AS 

BP 

5  200 

88 

408 

4.64 

8.6 

14.6 

400 

183 

830 

4.54 

9.8 

15.0 

600 

317 

1479 

4.67 

11.8 

18.0 

800 

378 

1835 

4.85 

10.6 

16.6 

1000 

530 

2441 

4.61 

11.4 

17.8 

10  200 

429 

1090 

2.54 

22.0 

25.6 

400 

714 

2687 

3.76 

26.4 

31.8 

600 

957 

4528 

4.73 

26.0 

36.0 

800 

1285 

5721 

4.45 

27.2 

34.0 

1000 

1769 

7/49 

4.38 

28.2 

36.8 

15  200 

1163 

2820 

2.42 

34.0 

49.6 

400 

1820 

6345 

3.49 

38.2 

56.0 

600 

2469 

9859 

3.99 

40.6 

58.2 

800 

3421 

13,460 

3.93 

46.0 

59.4 

1000 

4049 

17,867 

4.41 

47.6 

63.4 

20  200 

2733 

4303 

1.57 

49.0 

60.0 

400 

3863 

9936 

2.57 

53.0 

69.4 

600 

5542 

16,585 

2.99 

61.8 

77.4 

800 

6755 

23,128 

3.42 

64.4 

81.0 

1000 

8206 

29,312 

3.57 

67.0 

82.2 

Conclusions: 

In  this  paper  we  have  presented  an  algorithm  and  FORTRAN 
code  for  determining  L  norm  parameter  estimates  for  the  curve 

CO 

fitting  model  C  =  AT$  +  e.  This  algorithm  is  a  special-purpose 
linear  programming  dual  method,  and  the  code  is  compared  to 
the  special-purpose  code  of  Barrodale  and  Phillips. 

We  have  indicated  how  to  partition  the  A  matrix  to 
form  a  compact  or  reduced  basis,  and  how  the  usual  simplex 
tableau  entries  may  be  written  in  terms  of  this  reduced  basis. 
Special  ratios  are  developed  for  determining  the  vector  to 
leave  the  basis,  which  are  of  a  simplier  structure  than  the 
usual  simplex  ratios.  A  multiple  pivot  is  developed,  where 
movement  is  made  to  a  new  extreme  point  solution  without 
requiring  the  usual  basis  update  computations. 
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